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Study Staff & Roles 


>JPL 

■ J. Derleth, Mission & Technology Portfolio Optimization 

■ A. Elfes, ECS Data & Analysis 

■ B. Kennedy, ECT Data & Analysis 

■ R. Manvi, Tech Life Cycle & Risk Management Model 

■ K. Shelton, Mission & Technology Data Base 

■ J. H. Smith, Integrated Risk Analysis 

■ G. Rodriguez, System Analysis 

> GSFC staff (M. Steiner, J. Azzolini, J. Mapar, C. 
Stromgren) 


Study Objectives 

• Perform a pilot study of sufficient breadth which 
demonstrates in an auditable fashion how advanced space 
technology development can best impact future NASA 
missions 

- Include wide spectrum of missions & technologies 

- Can add new missions & technologies easily 

- Optimize technology portfolios 

- Lead to rapidly prototyped example 

• Show an approach to deal effectively with inter-program 
analysis trades 

• Explore the limits of these approaches and tools in terms of 
what can be realistically achieved (scope, detail, schedule, 
etc.) 
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Technology Portfolio Optimization Approach 

• Collect performance data for many individual 
technologies; each data input is viewed as a statistical 
sample representing an expert assessment 

• Group the technological data into a tree-like 
hierarchical model to predict “integrated” system, 
mission, and multi-mission impact of individual 
technologies 

i Search computationally for technology portfolios with 
optimal science return, risk and cost impact 

• Investigate sensitivity of the optimal portfolio to 
changes in available budget levels 


Major Study Challenges 

• Reference Missions : assess mission value; characterize capability 
requirements 

• Technology Projections : characterize performance; manage widely 
dispersed and non-uniform data 

• Uncertainty : incorporate & manage widespread uncertainty 

• ROl Measures : formulate suitable value function for portfolio 
analysis 

• Lavers of Abstraction : choose and maintain appropriate level of 
analytical abstraction 

• Technological Boundaries : boundaries of technology domains not 
clearly marked 

• Many Scales : large differences in cost and performance scales for 
different technologies 

• Performance Parameters : not fully understood for some technologies 
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Implementation Approach 


• Iterative in three phases (keep eye on big picture early, and 
continuously) 

- Phase 1 minimalist multi-mission set; ECT/ECS technologies 

- Phase 2 more extensive set of missions & technologies (June 04) 

- Phase 3 completion of full study (December 04) 

• Maintain high degree of connectivity 

- Space Architect 

- Revolutionary Mission Concepts 

- Advanced Space Technology Programs 

- Enterprises 

- Centers 

- Etc. 


Pilot Study Reference Missions 


(Organized by Science-Site Location) 


Pilot Study Reference Missions 


x 


I 


Earth Observation 


Earth's Moon 


Mars 


- Venus Surface L B i 0 mass** 

- OASIS* 

— Mars Science Lab 

— 

(1 -site land) 
Venus Surface 

— Lunar Sample Return 

— Mars Scout Line 

_ 

(Multi-site-land) 

— Comet Sample Return 

— Remote Lunar Survey** 

Lunar Precursor 
Resource Survey 

Mars Astrobiology Lab 
Mars Sample Return 


Outer Solar System I 


Europa Lander 


>lnitial reference mission set as of April 15, 2004 
>More missions and enabling technologies will be added 
throughout the period of performance of the study 

* OASIS is a near Earth transportation infrastructure that enables access to the Moon. It consists of: 
a Hybrid Propellant Module, a Chemical Propulsion Module, a Solar Electric Propulsion Module, 
and a Crew Transport Vehicle. 

** GSFC contribution to this study focuses on these missions 
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Reference Missions & Major Challenges 

(Minimalist Mission Set for PHASE I) 


Reference Mission Classes 
(not listed in order of priority) 

Major Challenges 

Earth's Moon: Orbital Aaareaation and SDace 
Infrastructure Systems (OASIS); Lunar Remote 
Survey; Lunar Surface Missions; etc. 

Deep Space Robotic Rendezvous & Docking; Long Term 
Cryogenic Fuel Storage in Space (>2 years); Long Life Ion 
Engines(>15 K-hours) 

Mars Surface: (e.a. Mars Science Laboratory: 
Astrobiology Field Lab; Mars Sample Return; etc.) 

Long-Range, Long-Life Mobility ( 10's of kilometers, >600 
sols); Substantive Sample Collection and Return (>lkg, 
0<depth< 1 00m subsurface) 

Earth Observation: Biomass 

Lidar/Radar Instrument Systems; Multi-Spectral Scanner; 
Sensor Webs & Data Fusion 

Outer Solar System: Titan Surface: F.urona Lander 

Extreme Environments; Sub-Surface Ice Mobility 

Inner Solar System: Venus surface: comet samnle 
return 

Extreme Environments (460C temp; 90 bar pressure; 
sulfuric acid clouds at 50 km) 


> Technologies to be evaluated will include: 

■ Technological products in several discipline fields (aimed at operational flight 
system implementation (e.q. advanced materials, structures, etc.) 

■ Risk assessment tools and infrastructure to allow for risk quantification, and risk 
mitigation during an entire mission life-cycle, but that do not necessarily appear in 
the flight system implementation (e.q. risk management methods) 


Enabling Technologies for Which 
Data Has Been Collected to Date 

• Extreme Temp & Pressure Components, Thermal Control, 
Pressure-Vessel-Encapsulated Electronics (Venus) 

• Electric & Chemical Propulsion; Reaction Control; 
Multifunction Structures; Fuel Storage & Control; Syntactic 
Foams, Formation Flying (OASIS) 

• Entry Descent & Landing; Surface, Aerial, Subsurface 
Mobility; Manipulation, Drilling, Sampling (Mars, Titan, 
Comet, Lunar Surface) 

• In-Space Inspection, Maintenance, Assembly (OASIS, Large 
Observatory Platform, Gateway, Space Solar Power) 

• Risk Methods, Tools and Workstation; Mishap Anomaly Data 
Base; Complex Systems Research; Risk Characterization & 
Visualization; etc. (All Reference Missions) 















Enabling Technology Areas 


(for which data has been collected to date) 


Enabling Technology Areas 

Missions 

Electric & Chemical Propulsion; Reaction Control; Multifunction 
Structures; Fuel Storage & Control; Syntactic Foams, Formation Flying; 
In-Space Robotic Inspection, Maintenance, Assembly 

OASIS 

Entry Descent & handing; Surface, Aerial, Subsurface Mobility; 
Manipulation, Drilling, Sampling 

Mars, Earth’s i 
Moon, Titan, 
Comet 

Risk Methods, Tools & Workstation; Mishap Anomaly Data Base; 
Complex Systems Research; Risk Characterization & Visualization; etc. 

All 

Extreme Temp & Pressure Components, Thermal Control, Pressure- 
Vessel-Encapsulated Electronics 

Venus, Titan, 
Europa 


Technology Areas are Decomposed into Many 
Sub-Areas & Performance Parameters 


A Few Typical 
Technology 
Areas 

A Few Typical 
Technology 
Sub-Areas 

A Few Typical 
Performance 
Parameters 

Multi-Function Structures 

Modular. Distributed Structures. 
Deployable Staictures, etc. 

Contract/Extend (cm). Power per 
Mass (W/kg), etc. 

Fuel Storage & Control 

On Orbit Cryrogenic Fuel Transfer. 
Tank Pressure Control. Fuel Storage, 
etc. 

Flow Rate (kg/min). Pressure 
(kPa). Time (yrs). etc. 

Subsurface Ice Mobility 

Range, Radiation Dose. Payload 
Capacity, Ambient Pressure, etc. 

Distance (km, mRads), Mass 
(kg). Pressure (atm), etc. 

Extreme Temperature & Pressure 
Components 

High Temperature Electronics, 
Permanent Magnets. Energy Storage, 
etc. 

Temperature (Celsius), Pressure 
(Bars). Energy Density (Whr/1) 
etc. 

Risk Methods, Tools & 
Workstation 

Model Based Risk Analysis, Mission 
Risk Profiling Capability, etc. 

Accessibility, applicability to 
multiple mission phases, risk 
mitigation coverage 


This is an early draft for April 15 lh , 2004. Please do not distribute. 
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Mission & Technology Data Base 




Mission & Technology Data Base 


■■ Current Size Summary -- 

Size of Mission & Technology Capability Data Base (as of April 15, 
2004) 

- 13 missions covering wide spectrum of NASA strategic plans 

- 23 technology areas (structures, energetics, extreme environments, surface 
mobility, etc.) 

- 86 technology sub-areas (batteries, payload capacity, thermal control, etc.) 

- 167 technological performance parameters (power density, operating 
temperature, etc.) 

Remarks About Data Base 

- Current data set is more detailed in some areas than in others 

- More technologies & detail will be collected in subsequent phases 

- Our analysis methods can handle data sets with non-uniform detail 


This is an early draft for April 15th. 2004 Please do not distribute 
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Risk Related Requirements 

(from Point of View of a Project Manager) 

• Risk Management Must: 

- Delineate major risks: Technical, Human, Organizational, 
Budgetary, and Schedules ;estimate and rank risk levels 

- Provide ways to visualize risk elements, time profile, and 
mitigation strategies 

- Assure that the systems and trade analysis includes cost, 
performance, and risk 

- Provide auditable benefit/cost of implementing begin-to-end risk 
mitigation strategies 


Connecting Risk Technologies 
to Requirements 

Requirements: 



□ Delineate major risks: Technical, 
Human, Organizational, Budgetary, 
and Schedules; estimate and rank risk 
levels 

□ Provide ways to visualize risk 
elements, time profile, and mitigation 
strategies 

□ Assure that a substantial portion of 
the design space is explored 
including cost, performance, and risk 

□ Provide auditable benefit/cost of ct 
implementing end to end risk •§ 


mitigation strategies 


-S ■ 

o <n 
Q) £ 

I- < 


Technology 

Peifoimance 

Attributes 



ECS: Engineering of Complex Systems 

> SRRM: System Reasoning and Risk Management 

• KESS: Knowledge Engineering for Safety and 
Success 

• RSO: Resilient Systems and Operations 
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System Reasoning and Risk Management 
(SRRM) Project Executive Summary 


Goals 


Objectives 


Advance scientific and engineering 
understanding of system risk, 
complexity, and failure. 


Develop processes & tools to identify, 
characterize, mitigate, trade, and track 
full lifecycle mission risks. 


Risks not well 
understood or well 

Challenges characterized, 

especially in early 
design phases 


Risk not an Data and interactions Integration of tools & 

inherent resource in complex systems data of differing detail, 

in design tradeoffs are difficult to model context, and pedigree 

and visualize for variety of decision - 

makers 


Analyze & model 

a I events and 

Approach interactions which 
have lead to system 
mishaps and failures 


Develop capability to 
fully characterize and 
model risk signatures 
early and consistently 


Mature & improve 
fidelity of subsystem 
models to capture 
failure modes and 
consequences 


Broaden the design 
space by fully 
integrating models 
and demonstrating 
the utility of risk as 
a tradable resource 


Technoloqv Accessibility of 

_ , historical risk 

Performance event data 
Attributes 


Potential to understand 
and reduce design 
risks and optimize 
resources to 
retire risks 


Risk model 
enhancement 
(potential for better 
model credibility) 


End-to-end risk 
integration for 
breadth of domain 


Degree of 
Alignment 
(Effectiveness 
in percent) 


Attribute Definitions 


Accessibility of 
risk data 


Potential to 
reduce design 
risks 


Risk model 
enhancement 


— z — 

x 


— z 

z_ 


z 

1 


Easy to use DB spans multiple mission/projects with risk events categorized 
for search. 

DB may be limited to specific category or series of missions. 

Supporting data/verifications are anecdotal (narrative) format without 
categories of risk events for easy search. May require further processing to 
another format. 


Technoiogy neips to identify and reduce risks during early phases of project 
(Phase A/B) with potential to dramatically reduce overall project costs by 
reducing rework. 

Technology helps identify/reduce mission risks for Phase C/D; Large 
potential cost benefits if used. Provides a screen that limits potential risks 
from passing CDR. 

Technology helps identify technology development or subsystem risks, but 
may or may not influence overall system risk. 


Technology provides new approach for addressing design risk life-cycle or 
part of life-cycle not previously addressed (e.g., mgmt, org. risks) 

Technology either provides new, more effective approach for risk analysis 
or fills missing gap in temporal or breadth of risk analyses (but not both) 
Technology does not address missing gap in design life-cycle. 


End-to-end risk 
integration 


Technology provides synergistic integration with other tools and databases 
fully compatible with emerging design environments (temporal and breadth). 
Risk technology allows interaction with common databases but cannot be 
integrated with other stand-alone applications. 

Technology is stand-alone; focused, narrow; little breadth or temporal range, 
databases are separated with little or no connectivity. Integration difficult. 








All SRRM Technology Areas Are 
Included for the Pilot Study 


1. Risk Methods/Tools (RMT) 

2. Risk Workstation (RWS) 

3. Mishap/Anomaly Database (MAIS) 

4. Model-Based Hazard Analysis (MBHA) 

5. System Complex Research (SCR) 

6. Risk Characterization/Visualization (RCV) 

7. Risk-Based Design (RBDO) 

8. Data Mining Research (DMR) 

9. Investigation Methods/Tools (IMT) 


Typical SRRM Technology Area Data* 


Technology 

Level 

Metric 

Unit 

Polarity 

SOA 

Low 

ML High 

$M 



How performance is 
measured 

What unit 
performance 
is measured 
in 

+ = Better if 
performance 
is higher 
- = Better if 
performance 
is lower 

Current 
state-of-the- 
art for 
similar 
technologies 

Technologist’s estimate 
of low, most likely, and 
high values of what will 
be provided to the 
mission 

How much the 
technologist 
needs to 
achieve TRL 6 
in $M 

ECS 

1 









SRRM 

2 









RISK Methods & 
Tools 

4 

Accessibility of Historical 
Risk Event Data 

0-10 

+ 

4 

7 

8 

9 

2 



Potential to Understand and 
Reduce Design Risks and 
Optimize Resources to Retire 
Risk 

0-10 

+ 

1 

7 

8 

9 




Risk Model Enhancement 
(Potential for Better Model 
Credibility) 

0-10 

+ 

2 

9 

10 

10 




End-to-end Risk Integration 
for Breadth of Domain 

0-10 

+ 

2 

8 

9 

10 




Extent of Needs Covered 

0-1 

+ 

0.5 

0.7 

0.8 

0 . 

9 



*SRRM data cast in same format used for all other technologies (shown in slide 14) 
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Mission-Technoloqv Complexity Ma 


Electric Propulsion 
Chemical Propulsion 
Radio-Thermal-Electric Power 
Reaction Control 
Multifunction Structures 
Deployable Structures 
Fuel Storage & Control 
Environmental control 

Thermal Control 
Autonomous Nav & Docking 
Temperature Sensors 
Pressure Sensors 
Position Sensors 

High Temperature Electronics for Sensors (CMOS) 
Multi-Sensor Integration 
Actuators Operating at High-Temperatures 
High-Temperature Electronics for Actuators (CMOS) 
Permanent Magnets (Cobalt-Samarium) 

High Temperature Batteries (Primary) 

High Temperature Batteries (Re-Chargeable) 

Phase Change Material Thermal Storage 

Thermal Insulation 

Thermal Switches 

Heat Pipes 

Active Refrigeration 

Pressure Vessel 

Smart Surface Coatings 

Sulfuric Atmosphere Protection 

Robotic In-Space Assembly 

Robotic In-Space Inspection 

Robotic In-Space Maintenance 

Surface Mobility 

Aenal Mobility 

Subsurface Ice Mobility 

Micro-g/Cryovac Mobility 

Manipulation 

Dnlling 

Sampling 

Investigating Methods/Tools 
Data Mining Research 
Risk Based Design 
Risk Characterization/Visualization 


|=1-2 technologies 
=3-4 technologies 
|=5 or more technologies 
=missing data 
? =possible tech need 


Analysis Options Used to Get Typical Results 

in Slides 25-30 


Analysis Options Used 

Other Options Available 

Uniform science-return value for all 
missions 

Can assign non-uniform science return 
value (user prescribed) 

Uniform value for all technologies at the 
same hierarchical level; “democratic” 
hierarchy 

Can prescribe general technology 
organizations; based for example on mission 
and system decomposition 

Technology correlations and co- 
dependencies set to zero 

Can explicitly include correlation & co- 
dependency parameters when available 

Risk estimates based only on performance 
uncertainty 

Can include cost, schedule and other risk 
factors 

Identical development time (-10 yrs) for all 
technologies 

Can vary technology development time as a 
model parameter 

TRL data not included in technology 
projections 

Can analyze TRL data within existing 
analysis framework 
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Overall Investment Strategy 


I ECS Technologies 


1200 □ Extreme Environments/Venus 

Surface Mission 
□ OASIS 


2 1000 

< 

JZ 

“ 800 

o 


0 > 

<D 

D) 

Ui 

CO 400 


I ■ In Space Assembly 

I 

a MISSION CLASS: MARS 
SURFACE MISSIONS 



150 275 400 525 650 775 

Budget, $M 


900 1025 1150 1275 1400 
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In Space Assembly 






Suggested $M for Each Area 
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Estimated Probability of Mission Enabled 


• MSL 


Estimated Impact of Technology Budgets 
on Missions Enabled — 

0 High funding*" ~ ~ * 

_ _|N« • 3 5 


x + + + + 

X \y w \y vX/ - VI/ I 

A A A A A /A, A — I 

. X X . _ * _ <i -•/ 

f< " M >( F< " r. r> X. / 

^ • • £ • ' • ■ ■ -? -/ 


- V- * * AX i 


Medium funding 


Mars Astrobiology Field Lab 
Titan Explorer 
XVenus Sample return 
• Europa 

+ Comet Sample Return 
-Lunar sample return 
- Space Station maintenance 
Large Observatory Platform 
Gateway 

Space Solar Power 
OASIS 
r HPM 


(Low funding 


1000 

Budget, $M 


— Venus Surface mission 
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Concluding Remarks 

* Study Results to Date (January-March, 2004) 

- Initial data base for 1 3 missions and 1 67 technology performance 
parameters in 23 technical areas, representing Code T,S,M,Y 
enterprises 

- Rapidly prototyped analysis capability to evaluate impact of 
technological investment on science and exploration return 

• Work Remaining (April-December, 2004) 

- Expand data base to include more enabling missions and 
technologies (e.g. modular distributed structures, etc.) 

- Conduct more in-depth analysis of the representation and fidelity 
of the existing data set, and a more detailed treatment of the 
consistency and integration across program elements 
Calibrate data base and analysis with extensive WHAT-IF 
computational 
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